DOCUMENT RESUME 



ED 453 059 



SE 064 603 



AUTHOR 

TITLE 

PUB DATE 
NOTE 

AVAILABLE FROM 



PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Dodridge, Melvyn 

Assessment Grading Systems and Regulations in Learning 
Outcome Models. 

1999-08-00 

10p.; Paper presented at the International Conference on 
Engineering Education (Ostrava, Prague, August 10-14, 1999). 
For full text: 

http : //www. ineer . org/Events/lCEE1999/Proceedings/papers/264 
/2 64 . htm . 

Guides - Non-Classroom (055) -- Opinion Papers (120) -- 

Speeches/Meeting Papers (150) 

MF01/PC01 Plus Postage. 

♦Educational Assessment; ^Engineering Education; *Evaluation 
Methods; Foreign Countries; Higher Education; Outcomes of 
Education; *Scoring 
United Kingdom 



ABSTRACT 



Learning outcomes and their assessment has given rise to 
considerable debate as to whether outcomes should be graded or just 
pass/fail . Assessment models employing learning outcomes have been used for 
some time in the United Kingdom (UK) in further education programs' for 
example National Vocational Qualifications (NVQs) and General National 
Vocational Qualification (GNVQs) , however, they have only recently been 
introduced into Higher Education study programs for example Higher National 
Certificates and Diplomas (HNCs/HNDs) . Learning outcome assessment models 
have not found favor in degree level programs in the university sector but 
this situation is likely to change as a result of the publication by the 
Quality Assurance Agency (QAA) for Higher Education in October 1998 entitled 
'The Way Ahead'. The new framework they have proposed will now be developed 
and implemented over the next few years and one of the key four areas is the 
program specification which will be outcome based. This paper reflects on the 
experience gained at the University of Derby where a learning outcomes model 
has been in operation since 1995. Where traditional grading systems and 
assessment regulations are in force the implementation of a learning outcomes 
model needs careful thought not only at program level, but also at 
institutional level. From the working experience a number of the pitfalls are 
examined at program level, for example, is the traditional end of module 
examination acceptable in this type of model? Should learning outcomes be 
tested on more than one occasion? Should referral work be similar to that set 
using the traditional model? At institutional level the purpose of the 
assessment boards needs to be re-examined as well as the appropriate method 
to present the assessment information. The author has joined a University 
working party whose remit is to reconsider the existing model and -regulations 
and in addition has the responsibility as Programs Manager in the Division of 
Electronic Systems. Principles in the application of learning outcomes are 
proposed together with some thoughts on the necessary changes in assessment 
regulations. Requirements for the various levels of professional status are 
defined in terms of competencies and when coupled with the QAA's requirements 
offers a major challenge in curriculum design. (Author) 
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Abstract: Learning outcomes and their assessment has giuen rise to considerable debate as to whether outcomes 
should be graded or just pass/fail. Assessment models emploging learning outcomes haue been used for some time 
in the UK in further education programmes for example National Uocational Qualifications (NUQs) and General 
National Uocational Qualification (GNUQs), howeuer, theg haue only recently been introduced into Higher Education 
study programmes for example Higher National Certificates and Diplomas (HNCs/HNDs). Learning outcome 
assessment models haue not found fauour in degree leuel programmes in the uniuersity sector but this situation is 
likely to change as a result of the publication by the Quality Assurance Agency (QAA) for Higher Education in October 
1998 entitled 'The Way Ahead*. The new framework they haue proposed will now be deueloped and implemented 
ouer the next few years and one of the key four areas is the programme specification which will be outcome based . 

This paper reflects on the experience gained at the Uniuersity of Derby where a learning outcomes model has been 
in operation since 1995. Where traditional grading systems and assessment regulations are in force the 
implementation of a learning outcomes model needs careful thought not only at programme leuel, but also at 
institutional leuel. From the working experience a number of the pitfalls are examined at programme leuel, for 
example, is the traditional end of module examination acceptable in this type of model? Should learning outcomes 
be tested on more than one occasion? Should referral work be similar to that set using the traditional model? At 
institutional leuel the purpose of the assessment boards needs to be re-examined as well as the appropriate 
method to present the assessment information. 

The author has joined a Uniuersity working party whose remit is to reconsider the existing model and regulations 
and in addition has the responsibility as Programmes Manager in the Diuision of Electronic Systems. Principles in the 
application of learning outcomes are proposed together with some thoughts on the necessary changes in 
assessment regulations. Acquirements for the uarious leuels of professional status are defined in terms of 
competencies and when coupled with the QAA’s requirements offers a major challenge in curriculum design. 

Keywords: assessment, learning outcomes, grading, regulations 



Traditional assessment methods and compensation 



Traditional methods of assessment in modular based programmes normally inuolues the marking and subsequent 
grading of coursework and examinations from which the ouerall module grade is calculated in accordance with the 
weighting of each element of assessment and assessment regulations. Assessment models haue employed learning 
objectiues for many years but the introduction of learning outcome or competence based models to the lower leuels 
of post school education nationally has now filtered into higher leuel programmes. 

R number of uniuersities and colleges offering degree and BTEC higher leuel programmes are now employing learning 
outcome models. In fact for new BTEC programmes this is now a mandatory requirement. In many cases howeuer all 
that has happened is that learning objectiues haue been renamed learning outcomes and the true purpose of 
employing such a model has been auoided. There is in many cases a mismatch between assessment regulations and 
the principles which underlie learning outcomes. 

Students are less clear on what they need to achieue in models employing learning objectiues. There may be some 
ouerall indication of the pass mark for a module and the weighting of indiuidual pieces of assessed work and to 
whether any compensation is allowed in the programme regulations. Assessment, in many cases, uses the traditional 
time constrained summatiue examination in which there is broad couerage of the module general objectiues. The 
paper normally offers a choice of questions typically four from six in two hours or fiue from eight in three hours. 
Compensation is normal in that poorly answered questions can be compensated by ones which are well answered. The 
student passes the module if the pass mark, usually around 40% is met. 



More recently there has been a moue away from programmes where all assessment is by summatiue examinations to 
formatiue assessment, in many cases using wholly coursework, or mixed mode assessment in which there is a 
combination of coursework and summatiue examination. Compensation is normally applicable whereby in the former 
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case, coursework marks are aueraged to produce the module mark and in the latter case a minimum criteria is set for 
passing both the coursework and the examination but a good performance, normally in the coursework, compensates 
for in this case a poor examination performance. In many cases the weighting of the examination is equal to or 
greater than 50% of the module assessment. Compensation increases the module pass rate but can be justified on 
the grounds that examination performance is usually graded lower than coursework. Standards are safeguarded by 
setting a minimum criteria. 

There are many possible reasons for the student performance in the examination being normally lower than that 
obtained in coursework in practice. For instance, examination technique, errors, misunderstandings, structure of 
questions, illness, reuision too little and too late, neruous problems, etc. 

The table in Figure 1 shows the required coursework performance with the minimum criteria set at 30% and a module 
pass mark of 40% foruarious coursework/ examination assessment weightings. Rs can be seen a good performance 
of 63% in coursework is required in the case of 70E/30C model. 



Format 


70E/30C 


50E/50C 


30E/70C 


Examination 


30% 


30% 


30% 


Coursework 


63% 


50% 


44% 


Ouerall Grade 


40% 


40% 


40% 



E/C - Examination/Coursework Weighting 

Fig. 1. Compensation between examination and coursework components 

In a true learning outcomes model it is expected that all the module outcomes must be achieued before credit is 
awarded and it is therefore difficult to see how the traditional summatiue examinations are compatible with this 
type of model. R learning outcomes model therefore preuents students from performing badly in items of assessed 
work or missing out altogether sections of the curriculum content whereas in a learning objectiues model employing 
compensation they may well haue passed. 

Traditional Grading Systems, Grade Reporting and Assessment Boards 

There are numerous grading systems in use some using numerical grades and others using alphabetical grades II], 
howeuer where assessment board reports are generated by computer controlled record systems a numerical base is 
used for calculating module grades in respect of the weighting of each assessed element. Many uniuersities allow 
compensation between the ouerall coursework grade and the end of module examination grade. Record systems can 
accommodate compensation but this can proue problematic when introducing the requirement to achieue learning 
outcomes. 

In practice many of the present assessment regulations were formulated prior to the introduction of the learning 
outcomes assessment model and no substantial changes haue been made since. There is the need for change as the 
present regulations are not compatible with the assessment of learning outcomes for a number of reasons. For 
example, the marks recorded on the Student Record System and reported on assessment board reports are traditional 
in nature and include an ouerall coursework mark, an examination mark and the ouerall module mark from which the 
module grade is obtained. 

Traditional grading systems take no account of the achieuement or failure of learning outcomes. Failure is normally 
restricted to flagging up whether the failure is in coursework, examination or both. It is normal for the marking tutor 
to hold information on the exact nature of any failure as in the main data bases used in assessment record systems 
are inadequate. The coursework element is likely to comprise of seueral learning outcomes and euen the examination 
may include more than one. The result for each assessed element is not reported euen if it can be recorded on the 
Student Record System where marks are inputted at assessment leuel, and therefore there is no mechanism to record 
success or failure at learning outcome leuel. R typical module assessment board report is shown in Fig. 2. 





Coursework 


Examination 


Module Grade 




Weighting 75% 


Weighting 25% 


Numeric 


Rlphabetic 


STUDENT R 


14.33 


14.00 


14.25 


C+ 


STUDENT B 


9.00 


13.00 


10.00 


D- 



http://www.lnaar.org/Event8/ICEE1999/Proceading8/paparS/264/264.htm 

ERIC 



4 



Thursday, March 22, 2001 



ICCC'99, Czech Republic, Paper No. 264 



Page: 3 



Fig. 2. Typical module assessment board report 

The minimum pass mark in this grading system is 9.50 but compensation is allowed in coursework or examination 
down to 6.00, prouided the ouerall mark is 9.50 or greater. Now, student H passes both elements and receiues the 
grade C+ for the module on their transcript, howeuer student B also passes with the lowest pass grade despite failing 
to meet the ouerall coursework requirements because compensation is ualid. Lets suppose that the coursework is 
diuided into three elements equally weighted and that student B fails to submit anything for the second of the three 
coursework assessments. Rs stated the student passes on the ouerall performance but in a learning outcomes model 
would haue failed if a learning outcome(s) is attached to each assessment. In effect compensation can be applied 
twice in the traditional model, i.e between coursework elements and/or between the coursework and examination 
components. 

Modular based programmes usually employ two assessment boards although these may be run concurrently. Module 
boards make decisions in respect of module grades and consider each module and the students taking the module. 
Decisions are normally pass with appropriate grade, referred in coursework, referred in examination, referred in both 
coursework and examination or outright fail. The board howeuer should be making decisions on achieuement or 
non-achieuement of learning outcomes where learning outcome models are employed. The obsession with numerical 
marks often leads, in the case of poor performance, to the raising of the mark resulting in a pass grade being 
awarded for the module. Little is mentioned on the status of learning outcomes. This effectiue compensation is 
processed with complete disregard to learning outcome failure and to the students ouerall profile which is only seen 
at the programme board. 

Programme boards make decisions in respect of progression and awards. Each students ouerall profile is considered. 
The Module board may haue made decisions to condone a low mark which is effectiuely compensation, howeuer 
further decisions on compensation can be made at the programme board. Decisions at the first board may be 
reuersed, for example, a referral in one module out of the academic year’s work may be condoned as a pass in order 
to allow progression or facilitate an award. This in fact is another mechanism to allow compensation. The processes 
carried out at both of these two boards seem unnecessarily complex. 

There are considerable differences in philosophy with respect to grading. Competence based programmes such as 
National Llocational Qualifications (NUQs) are in the main skills based and grade outcomes as pass or fail. LIJith a skill 
there must be a threshold leuel which merits a pass and clearly there are many examples where any further grading 
would serue no real purpose. The National Open College Network who offer foundation programmes which can lead 
into degree programmes also grade in the same manner. In General National Docational Qualifications (GNDQs) a pass 
grade is automatically awarded where there is euidence of all of the requirements being met. Rn ouerall merit or 
distinction howeuer, can be awarded if a third or more of the euidence meets the grading criteria for merit or 
distinction. 

Rlthough uniuersity degree programmes and BTEC Higher National Certificates and Diplomas may haue elements which 
are skills based they also include knowledge, understanding, intellectual skills and transferable skills. Giuen that 
degree programmes are awarded with a classification and that BTEC modules are graded pass, merit or distinction 
then there is euery reason to consider a threshold leuel in order to pass a learning outcome and to reward 
performance in excess of this by an appropriate grade. 

Three common approaches to learning haue been identified in seueral studies. Biggs [2] and others classified students 
into three learning categories: 

t. Surface Learners - These show little interest in ideas and deeper meanings and they prefer rote learning and 
highly structured forms of teaching and assessment. 

Z Deep Learners - These are interested in the subject matter, they haue less interest in facts and are liable to 
be problem solues. They prefer flexibility in teaching and assessment. 

5. Rchieuing Learners - These are highly organised, haue an interest in attaining high results and relate their 
learning to the importance of the materials in examinations. They adopt surface or deep learning to suit their 
desired aims. 

Traditional examinations suit surface learners who haue good memories and knowledge of a subject. Students in this 
category could also be expected to problem solue at a basic leuel. Coursework howeuer suits deep learners 
particularly where assignments are open ended. Rchieuing learners would find a combination of examination and 
coursework more appropriate to obtaining the highest grade. Surface learners may well be satisfied with just a pass 
grade howeuer deep and achieuing learners would benefit from assessment opportunities which are graded. 

Learning Outcomes Reporting 

The present method of recording and reporting assessment data was quite suitable in the pre-learning outcome days 
for regulatory frameworks with or without mixed mode compensation. Assessment board decisions in respect of 
referral were only ualid in the pre-learning outcomes model. LlJhen the learning outcomes model was introduced at 

O 
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the Uniuersity of Derby the regulatory framework remained in force and only in light of operational experience were 
shortcomings noted. The main problem was with mixed mode compensation and under this arrangement it was 
possible to record a module pass grade in cases where there was a learning outcome(s) failure. The author of this 
paper prouided a solution in which one of two numerical ualues could be recorded in the case of a learning 
outcome(s) failure. The ualues chosen were set just below the two threshold leuels for a pass as they would be 
unlikely to occur in practice. The ualues of 5.99 (threshold leuel 6.00) or 9.49 (threshold leuel 9.50) were used to 
record a learning outcome failure in mixed mode and single mode assessment respectiuely. Howeuer, this is only used 
where a student would haue otherwise receiued a pass mark. The recording of these ualues is the responsibility of 
the module tutor and if forgotten may result in a pass grade being awarded. The actual learning outcomes failed are 
not recorded in this case and neither in the case of where a referral grade is awarded in other circumstances. 

Unlike the present regulatory system which treats ouerall coursework with the same status as the traditional end of 
module examination, a true learning outcomes model would attach the same status to each outcome, and subsequent 
recording and reporting should reflect this. The method of assessment which we put so much emphasis on in our 
board reports i.e. ‘coursework 1 and ‘examination 1 is irreleuant in a learning outcomes model. LUhat is required is uery 
simple and inuolues recording for each assessment, irrespectiue of the assessment mode, the grade where the 
learning outcome has been achieued and failure where it has not been achieued. Compensation cannot reasonably be 
considered at this leuel but may be appropriate at the stage or programme leuel. The requirements of a module 
assessment board report are shown in Figure 3. It is considered howeuer that it would be more meaningful for all 
assessment data to be reported in the alphabetical scale as this is more meaningful to the assessor and external 
examiner. 





RSS 1 


RSS 2 


RSS 3 


RSS 4 


MODULE GRRDE 




UJ%25 


LU%25 


LU%25 


LU%25 


Numeric 


Rlphabet 


STUDENT R 


11 


15 


17 


14 


14.25 


C+ 


STUDENT B 


12 


LD2 


15 


13 




F 



Fig. 3. Learning Outcomes module assessment board report 

If an assessment included more than one learning outcome and more than one is failed then more digits will be 
required e.g. learning outcome 2, 3 (LD 2,3). Where a learning outcome(s) is failed the module grade is not calculated, 
the result is simply fail (F). The requirement for a module board is therefore questioned since at this leuel i.e. module 
leuel the student either achieues or fails to achieue the learning outcomes. Modules are either pass with appropriate 
grade or fail. There is one situation where module board papers usefully present data in respect of each module so 
that exceptionally good or poor performance as opposed to a normal distribution can be easily spotted. Howeuer 
module data and statistics can be presented at the Programme Board. I therefore cannot see any reason why it 
would be more appropriate to ratify decisions applying to learning outcomes at a module board. In a learning 
outcome model, utilising module reports as shown, the information will be clearly reflected when the students profile 
is examined in the programme reports. The employment of one board in addition offers a significant cost aduantage. 

Is Compensation ualid in a Learning Outcomes Model? 

It has already been argued that compensation at module leuel is inappropriate. Howeuer, at Stage or Programme 
leuel, it may well be justified, when considering a student’s ouerall profile. EDEHCEL regulations state for BTEC 
programmes that a pass is awarded for the achieuement of all outcomes against the specified assessment criteria. 
Outcomes typically number 2 to 4 with 3 to 5 assessment criteria for each outcome. R Higher National Diploma 
programme comprises 16 modules and therefore typically a total of 192 criteria haue to be met during the duration 
of the programme. There are two issues, firstly, are there too many outcomes, and secondly is it necessary to 
achieue all of them? There is some confusion as to what the term ‘assessment criteria 1 means, and there appears to 
be no common answer when examining a number of learning outcome models. Taking an example from the BTEC model 
with an outcome which has 4 criteria as follows: 

Dutcome: Inuestigate circuits with feedback 

Criteria: 

• Deduce an expression for the closed loop gain of a feedback system. 

• Determine the conditions for stability and the effects on circuit performance when feedback is applied. 

• Design a circuit employing negatiue feedback. 

• Inuestigate the effects of applying feedback to single and multiple stage circuits. 

Despite the outcome itself being uery general, it should be of fundamental or of intrinsic importance to the module. 
‘Design a circuit employing negatiue feedback 1 is more specific outcome but couers most of the requirements in the 
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topic of ‘negatiue feedback’. The corresponding assessment criteria would be the euidence to ensure the design has 
been accomplished. Totalling the outcomes on this basis now giues 48 - a more reasonable number. Regarding the 
second point of compensation, the need to achieue all 48 outcomes in the preuious example is questioned. To quote 
from the Rmerican Rssociation for Higher Education [3]: ”UJe should not articulate a uision for the ideal graduate as a 
mandate for euery graduate of euery engineering programme to demonstrate competence and proficiency in euery 
attribute. Each goal is a yardstick against which to measure programme success, not an item on a checklist to 
inuentory failure.” It would therefore be reasonable to say, compensate for one or two learning outcome failures on 
the basis of good performance in others. It is important in modular programmes to ensure that the specific identity 
of the programme is reflected in the award, and it would therefore seem sensible that all learning outcomes in core 
modules should be achieued and any failure confined to optional modules. Clearly it would not be possible to 
compensate in some cases and where these occur the failed learning outcome(s) needs to be recorded for each 
module concerned. This is much simpler and a more precise method than used at present, where in particular 
reporting referred in coursework is open to interpretation. Rs in the present regulations there would be the need for 
trailing the achieuement of learning outcomes into the next semester or year and in order to maintain quality control 
the requirement to terminate study where a high number of learning outcomes haue been failed. 

Grading & Performance Indicators 

The need for twelue pass grades and fiue fail grades in the Uniuersity of Derby grading system [1] is questioned in a 
learning outcomes assessment model. There are only four honours degree classifications which is a good argument to 
reduce the number of grades to for example just R, B, C and D. One fail grade is also sufficient as the degree of under 
performance can be indicated by the assessor on the Student Rssessment Record Form. Many competence based 
models use only pass and fail grades and this is clearly inadequate, for in particular, the ‘achieuing’ student. EDEHCEL 
BTEC programmes use three grades which may well proue sufficient in any learning outcomes model. Grade 
descriptors giue an indication of the leuel of performance and clearly the number would reduce in line with fewer 
grades. The present descriptors in the Derby grading system are confusing in any case since there are too many 
grades. The wording of descriptors are therefore quite similar in grades aboue and below any particular grade. 

EDEHCEL BTEC programmes haue recently introduced a learning outcomes model and haue reuised their descriptors for 
pass, merit and distinction performance. [4] Howeuer, within the last year they haue withdrawn the pass descriptor. 
This would appear logical since pass performance is simply achieuing the learning outcome. In the Derby grading 
system this would be equiualent to remouing the D- descriptor. The latest uersion of the BTEC merit and distinction 
descriptors are stated as:- 

Merit Grade Descriptor 

In order to achieue a merit the student must: 

• use of a range of methods and techniques to collect, analyse and process information/data 

• apply and analyse detailed knowledge and skills, using releuant theories and techniques 

• coherently present and communicate work using technical language accurately. 

Distinction Grade Descriptor 

In order to achieue a distinction the student must: 

• check ualidity when collecting, analysing and processing complex information/data 

• eualuate and synthesise releuant theories and techniques to generate and justify ualid conclusions 

• show an indiuidual approach in presenting and communicating work coherently, using technical language 
fluently. 

To quote from the EDEHCEL guidelines:The grade descriptors listed are for grading the total euidence produced for 
each unit (module). In order to do this, the descriptor should be contextualised and incorporated into the design of 
assessment actiuities. Some units may not giue the opportunity for the use of all the features of the Merit or 
Distinction grade descriptors. Consequently, centres should select the appropriate features of the grade descriptors 
for those units. Students’ work should then be assessed using the assessment criteria and contextualised grade 
descriptors. 

Some of the Pitfalls in Learning Outcome Models and Grade Recording 

Experience has shown that there is a tendency for module designers to specify too many learning outcomes for 
example as many as eight in a module with around 100/128 hours of notional learning time. Students may not achieue 
all of the outcomes and this presents problems for assessment boards as to whether to offer a referral opportunity 
or to condone any failed outcomes. In many cases some of the learning outcomes may not be of intrinsic ualue to the 
module and three to four learning outcomes for the module size stated is now considered a manageable number for 
students to achieue thus auoiding potential ouer assessment. EDEHCEL BTEC programmes now include in their module 
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specification learning outcomes as illustrated in their neui guidelines [4]. It should be noted that 3 to 4 learning 
outcomes is the norm. 

One question which always causes debate is whether learning outcomes should be tested more than once prior to 
formal referral. For example where a module is assessed by both coursework and summatiue examination, learning 
outcomes may be tested twice, once in coursework and again in the examination. This howeuer can proue 
problematic as discussed in one of the following examples. Many learning outcome models can be deuised but careful 
thought is required to auoid pitfalls. Problems can result for the tutor, the student and in the subsequent recording of 
grades. Some examples are shown in Fig. 4. 



Assessment 


Learning Outcomes 




Example (a) 


Example (b) 


1 


1.2 


1 


2 


2,3 


2 


3 


3,4 


3 


4 * 


1,4 


1,2,3 



♦Summatiue examination in example (b) 

Fig. 4. Example Learning Outcome Assessment Models 

In example (a) Learning Outcome(s) are tested twice (all coursework). LUhilst there should be adequate opportunities 
for achieuing learning outcomes, if more than one attempt is allowed prior to formal referral, this can lead to 
difficulties in recording success or failure. In this example each assessment tests two learning outcomes and each 
outcome is tested twice. There are two problems when it comes to recording grades. For example a student could 
pass in Assessment 1 say Learning Outcome 1 but fail Learning Outcome 2 which is retrieued in Assessment 2 and 
Learning Outcome 1 is then failed in Assessment 4. Firstly if Learning Outcome 1 is passed in Assessment 1 there is no 
need to repeat it in Assessment 4 and therefore it may not be possible to undertake Assessment 4 if Learning 
Outcome 4 only is required. The second point is that it is not possible to grade Assessment 1 or Assessment 4 and a 
learning outcome failure should be recorded euen though one of the learning outcomes has been achieued in each. A 
pass grade cannot be recorded euen if ouerall the work is considered to be in that category. 

Example (b) is similar to example (a) except that it contains an end of module examination. Similar difficulties arise, 
for example, it can be argued that if the student has passed Assessments 1 to 3 there is no need to take the 
examination as the outcomes haue already been achieued. On the other hand if an outcome needs to be achieued in 
the examination how can the tutor ensure there is an opportunity where there is a choice of questions? 

Principles in the application of Learning Outcomes 

The learning outcomes working group at the Uniuersity of Derby debated the preuiously mentioned issues at length 
and formulated a number of principles in the application of learning outcomes which would auoid the pitfalls outlined. 
These are: 

• Learning Outcomes are learning achieuements which are fundamental to the ouerall aims of a module. 

• Each designated learning outcome should be distinct from other learning outcomes and should not be compound 
in structure 

• A pass grade is only awarded for an assessed piece of work if the learning outcome(s) haue been satisfied. 

• Each learning outcome should be formally assessed once prior to referral or retake, 

• There should only be a small number of learning outcomes for each module (2 to 4 are suggested for a module 
with a notional learning time of 120 hrs) 

Two examples are shown in Fig 5 
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Assessment 


Learning Outcomes 




Example (a) 


Example (b) 


1 


1 


1,2 


2 


2 


3,4 


3 


3 




4 


4 





Fig 5. Suitable Learning Outcome Assessment Models 

Example (a) is uery simple to operate but some tutors mould prefer to haue fewer but longer assessments as in 
example (b). Where more than one learning outcome is assigned to an assessment the record system must be capable 
of recording and reporting data on any failed outcomes. 

Referral Opportunities 

Assessment regulations whether traditional or where a learning outcome model is employed in the assessment 
process will haue safeguards for underperformance usually in the form of referral or retake opportunities. Howeuer 
such regulations differ considerably and in some cases are influenced by external bodies such as accreditors. In some 
accredited programmes there is for example uery little in the way of referral opportunity in the first stage, the 
degree classification being determined by the first time attempt. There has howeuer been notable changes in recent 
years particularly in competence based programmes such as NUQ’s and GNUQ’s 

Issues for consideration should include: 

• Should we prouide a much earlier formal opportunity for redeeming failure. 

• Is there a case for informal referral? 

• Should the module grade be capped at the lowest pass grade following success in referral 

• How many referral opportunities should there be? 

• Should retaking a module be replaced by multiple referral opportunities? 

Assessment by portfolio has been traditionally used in art and design programmes but less so in engineering. It is 
increasingly being used at the lower leuels e.g. NUQ’s and GNUQ’s where students keep their assessed work, in a 
binder for example, thus enabling tutors, assessors, uerifiers, prospectiue employers etc see their achieuements. 

Final grading is summatiue and when all the euidence meets the requirements of all modules. Formatiue feedback is 
giuen howeuer on the students progress towards meeting the grading criteria throughout the programmes so they 
can concentrate on areas of their work which need improuement. The aduantage is that as students gain experience 
and skills with progress it is likely that later assessment actiuities will prouide more euidence towards the grading 
criteria than earlier work. 

With traditional assessment methods referral work is normally different, particularly in examinations, to the original 
work set and therefore in a learning outcomes model it can be more difficult to set another piece of work addressing 
the same outcome. The question is raised as to the work set for a referral in cases where the existing work 
addressed seueral outcomes but where only say one outcome has been failed. Should the student retake the work in 
its entirety or should work only address the failed outcome? It may by quite difficult to set a separate piece of work 
addressing the one outcome but on the other hand if possible it can be used to aduantage in reducing marking time. 

The other issues mentioned are still being debated but in some cases may be difficult to resolue whilst there is a 
mismatch between current assessment regulations and the principles which underlie learning outcomes. 

The Quality Rssurance Rgency 

The Quality Assurance Agency (QAA) for Higher Education set out a new quality assurance framework [5] in October 
1998 which will be deueloped and implemented in the near future. 

To support the new approach, work will be completed on:- 

• the Qualifications Framework 

• Programme Specifications 

• Subject Benchmark Standards 

• Codes of Practice 
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Assessment of student learning is considered under the heading of Programme Specifications and the QHH haue 
published a document entitled. ’’Guidelines for Preparing Programme Specifications”. [6] 

The QHH suggests the primary purpose of the Programme Specification to be: 

• to prouide clear and concise information for intending students employers etc. on the intended outcomes of 
programmes of study. 

• to help teaching teams set out clearly and concisely. 

• the learning outcomes of their programmes of study. 

• the teaching and learning methods that enable learners to achieue these. 

• the assessment process that demonstrates their achieuement. 

The QHH mill be making and reporting judgements at the ’’subject/programme” leuel. The reuiem cycle mill include 
’’the appropriateness of student assessment methods as instruments for measuring the intended outcomes”. 
Learning outcome models and assessment regulations mill therefore be debated at length as me enter the next 
millennium in light of current experience 
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